Phase transitions of neural networks
نویسندگان
چکیده
منابع مشابه
Phase Transitions of Neural Networks
The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This is demonstrated for a few examples: Perceptron, associative memory, learning from examples, generalization, multilayer networks, structure recognition, Bayes...
متن کاملPHASE TRANSITIONS IN NEURAL NETWORKS Joshua
Various simulat.ions of cort.ical subnetworks have evidenced something like phase transitions with respect to key parameters. We demonstrate that. such transi t.ions must. indeed exist. in analogous infinite array models. For related finite array models classical phase transi t .ions (which describe steady-state behavior) may not. exist., but. there can be distinct. quali tative changes in ("me...
متن کاملBoundary conditions and phase transitions in neural networks. Theoretical results
The purpose of this paper is to present some relevant theoretical results on the asymptotic behaviour of finite neural networks (on lattices) when they are subjected to fixed boundary conditions. This work focuses on two different topics of interest from the biological point of view. First, it exhibits a link between the possible updating iteration modes in these networks, whatever the number o...
متن کاملPhase transitions in dilute, locally connected neural networks.
We report numerical studies of the "memory-loss" phase transition in Hopfield-like symmetric neural networks in which the neurons are connected to all other neurons within a local neighborhood (dense, short-range connectivity). The number of connections per neuron, K, scales as the number of neurons, N, raised to a power less than one (i. e., K ~ Nη, η< 1) We use the recently developed LeeKoste...
متن کاملWeight decay induced phase transitions in multilayer neural networks
We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We consider the learning of perfectly realizable rules and find that the length of student vectors becomes infinite, unless a proper weight decay term is added to the energy. Then, the system undergoes a first order phas...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Philosophical Magazine B
سال: 1998
ISSN: 1364-2812,1463-6417
DOI: 10.1080/014186398258861